Teaching Open Science Analytics in the Digital Age

class: center, middle, inverse, title-slide

# Teaching <br> Open Science Analytics <br> in the Digital Age
## Q-RaP and teaching in the ☁️
### Barry Quinn

---

layout: true
<div class="my-footer">
<span>
<b>quinference.com</b></a> - Barry Quinn
</span>
</div> 
---

.bg_digital::before {    
      content: "";
      background-image: url('img/digital-transformation.jpg');
      background-size: cover;
      position: absolute;
      top: 0px;
      right: 0px;
      bottom: 0px;
      left: 0px;
      opacity: 0.4;
      z-index: -1;
}
</style>

# Outline
.salt[
- Credibility and relevance in teaching
- Open science analytics
- Some examples in my teaching
- What is Q-RaP?
- Why use Q-RaP?
]

---
class: middle

# Credibility and relevance crisis

- Relevance and quality of research in business schools has been under attack for more than two decades. (Hambrick 1994, Harvey 2017)

([Responsible Research for Business and Management 2020 Position Paper](https://www.rrbm.network/position-paper/)) argues:

- .large[CREDIBILITY:]<br> Research quality and integrity are under attack as evaluation systems promote bad research practices encouraging novelty over replicability.
- .blockquote[Responsible research, using open science principles, can provide useful and credible knowledge.]

- .large[RELEVANCE:] <br>Research feeds knowledge to business education, yet there is a widening gap between research and practice.

.footnote[Don Hambrick’s (1994) presidential address at the 1993 Academy of Management’s annual meeting is often cited as the beginning of this conversation in the management field]

---
class: middle

# Open science

.hand[Open Science is about increasing rigour, accountability and reproducibility for research]

.blockquote[
Open Science is the practice of science in such a way that others can collaborate and contribute, where research data, lab notes and other research processes are freely available, under terms that enable reuse, redistribution and reproduction of the research and its underlying data and methods. 
]
<br>
.blockquote[
In a nutshell, Open Science is transparent and accessible knowledge that is shared and developed through collaborative networks (Vicente-Sáez & Martínez-Fuentes 2018).
]

.footnote[[Open Science Training Handbook 2020](https://open-science-training-handbook.gitbook.io/book/open-science-basics/open-concepts-and-principles)]

---
class: inverse

# Open science analytics

.pull-left-1[
.huge-text[Goals]
]

.pull-right-2[
1.  Produce interesting output with data (and code) within the first ten minutes of the first class, 
  - The knock-on effect is to challenge students to infer meaning from data and statistics from day one.
  
2. Get students to think about computation as an integral part of their analytics curriculum[@Kaplan2007; @Cetinkaya-Rundel2018;@Quinn2022]

3. Demystify the [folk theorem of statistical computing](https://statmodeling.stat.columbia.edu/2008/05/13/the_folk_theore/) 
4. Produce relevance students

5. Computation as a friction less part of curricula
6. Active learning from mistakes

7. Growth mindset learning
]

---
class: middle

## Active learning and the 15 minute rule

- We will use the **15 minute** rule in this class.
  - If you encounter problems, spend 15 minutes troubleshooting on your own.
  - Make use of Google and StackOverflow to resolve the error
  - If your problem is not resolved after 15 minutes.
  - Use my Slack channel to **[ask for help]**. join [here](https://join.slack.com/t/rethinkingeco-3ss9716/shared_invite/zt-12nfdfr7o-XAy2Ef1knAKXgUNo2kWw3w)

---
class: middle

# Open science analytics

.pull-left[
.salt[Principles]
- Experiential learning (brake it to learn it)
- Embedding real-world practice
- Analytics integrity
- Culture of curiosity (not competition)
- Literate programming ([Knuth (1992)](https://www-cs-faculty.stanford.edu/~knuth/lp.html))
]
.pull-right[
.acid[Teaching environment toolkit]
- Open source software 
- <svg aria-hidden="true" role="img" viewBox="0 0 581 512" style="height:1em;width:1.13em;vertical-align:-0.125em;margin-left:auto;margin-right:auto;font-size:inherit;fill:blue;overflow:visible;position:relative;"><path d="M581 226.6C581 119.1 450.9 32 290.5 32S0 119.1 0 226.6C0 322.4 103.3 402 239.4 418.1V480h99.1v-61.5c24.3-2.7 47.6-7.4 69.4-13.9L448 480h112l-67.4-113.7c54.5-35.4 88.4-84.9 88.4-139.7zm-466.8 14.5c0-73.5 98.9-133 220.8-133s211.9 40.7 211.9 133c0 50.1-26.5 85-70.3 106.4-2.4-1.6-4.7-2.9-6.4-3.7-10.2-5.2-27.8-10.5-27.8-10.5s86.6-6.4 86.6-92.7-90.6-87.9-90.6-87.9h-199V361c-74.1-21.5-125.2-67.1-125.2-119.9zm225.1 38.3v-55.6c57.8 0 87.8-6.8 87.8 27.3 0 36.5-38.2 28.3-87.8 28.3zm-.9 72.5H365c10.8 0 18.9 11.7 24 19.2-16.1 1.9-33 2.8-50.6 2.9v-22.1z"/></svg> <svg aria-hidden="true" role="img" viewBox="0 0 448 512" style="height:1em;width:0.88em;vertical-align:-0.125em;margin-left:auto;margin-right:auto;font-size:inherit;fill:currentColor;overflow:visible;position:relative;"><path d="M416 208H272V64c0-17.67-14.33-32-32-32h-32c-17.67 0-32 14.33-32 32v144H32c-17.67 0-32 14.33-32 32v32c0 17.67 14.33 32 32 32h144v144c0 17.67 14.33 32 32 32h32c17.67 0 32-14.33 32-32V304h144c17.67 0 32-14.33 32-32v-32c0-17.67-14.33-32-32-32z"/></svg> <svg aria-hidden="true" role="img" viewBox="0 0 448 512" style="height:1em;width:0.88em;vertical-align:-0.125em;margin-left:auto;margin-right:auto;font-size:inherit;fill:blue;overflow:visible;position:relative;"><path d="M439.8 200.5c-7.7-30.9-22.3-54.2-53.4-54.2h-40.1v47.4c0 36.8-31.2 67.8-66.8 67.8H172.7c-29.2 0-53.4 25-53.4 54.3v101.8c0 29 25.2 46 53.4 54.3 33.8 9.9 66.3 11.7 106.8 0 26.9-7.8 53.4-23.5 53.4-54.3v-40.7H226.2v-13.6h160.2c31.1 0 42.6-21.7 53.4-54.2 11.2-33.5 10.7-65.7 0-108.6zM286.2 404c11.1 0 20.1 9.1 20.1 20.3 0 11.3-9 20.4-20.1 20.4-11 0-20.1-9.2-20.1-20.4.1-11.3 9.1-20.3 20.1-20.3zM167.8 248.1h106.8c29.7 0 53.4-24.5 53.4-54.3V91.9c0-29-24.4-50.7-53.4-55.6-35.8-5.9-74.7-5.6-106.8.1-45.2 8-53.4 24.7-53.4 55.6v40.7h106.9v13.6h-147c-31.1 0-58.3 18.7-66.8 54.2-9.8 40.7-10.2 66.1 0 108.6 7.6 31.6 25.7 54.2 56.8 54.2H101v-48.8c0-35.3 30.5-66.4 66.8-66.4zm-6.7-142.6c-11.1 0-20.1-9.1-20.1-20.3.1-11.3 9-20.4 20.1-20.4 11 0 20.1 9.2 20.1 20.4s-9 20.3-20.1 20.3z"/></svg> <svg aria-hidden="true" role="img" viewBox="0 0 448 512" style="height:1em;width:0.88em;vertical-align:-0.125em;margin-left:auto;margin-right:auto;font-size:inherit;fill:currentColor;overflow:visible;position:relative;"><path d="M416 208H272V64c0-17.67-14.33-32-32-32h-32c-17.67 0-32 14.33-32 32v144H32c-17.67 0-32 14.33-32 32v32c0 17.67 14.33 32 32 32h144v144c0 17.67 14.33 32 32 32h32c17.67 0 32-14.33 32-32V304h144c17.67 0 32-14.33 32-32v-32c0-17.67-14.33-32-32-32z"/></svg> <svg aria-hidden="true" role="img" viewBox="0 0 640 512" style="height:1em;width:1.25em;vertical-align:-0.125em;margin-left:auto;margin-right:auto;font-size:inherit;fill:blue;overflow:visible;position:relative;"><path d="M257.981 272.971L63.638 467.314c-9.373 9.373-24.569 9.373-33.941 0L7.029 444.647c-9.357-9.357-9.375-24.522-.04-33.901L161.011 256 6.99 101.255c-9.335-9.379-9.317-24.544.04-33.901l22.667-22.667c9.373-9.373 24.569-9.373 33.941 0L257.981 239.03c9.373 9.372 9.373 24.568 0 33.941zM640 456v-32c0-13.255-10.745-24-24-24H312c-13.255 0-24 10.745-24 24v32c0 13.255 10.745 24 24 24h304c13.255 0 24-10.745 24-24z"/></svg>
- Cloud computing
- Version control
- Computational notebook
- Web apps
- Simulation (fake it before you make it)
]

---
class: middle

# Cost of open science analytics

- Upskill and reskill colleagues
- Resistance from higher ups
- IT and DevOps support
- ?????

---
class: middle

.huge-text[What is Q-RaP?]

### Qms-Remote analytics Platform

--
.acid[It consists of two parts]
.pull-left[
**Advanced Teaching and Research**
- High-Performance Cloud Computing Suite
- Hosted in Azure
- Managed by [QMS DevOps Team](https://quinference.com)
- For Advanced Analytics at PGT and PGR level
- Analytics platform
- Visualisation platform
- Access on approval form
]
.pull-right[
**Foundational Teaching**
- RStudio Cloud (200+ students concurrently)
- 2022 semester two analytics modules on the masters
  ]

---
class: middle

## Examples of use

.pull-left[
![](data:image/png;base64,#img/qrap/connect1.png)
]

.pull-right[

[https://q-rap.connect.qub.ac.uk/QSMF/](https://q-rap.connect.qub.ac.uk/QSMF/)

---
class: middle

## Examples of foundational use

![](data:image/png;base64,#img/qrap/rscloud.png)

---
class: middle

## Infrastructure

.pull-left.blockquote[
- RStudio Team is a bundle of RStudio's enterprise-grade professional software for scaling data science analytical work across your team, sharing data science results with your key stakeholders, and managing R and Python packages.

- RStudio Team includes RStudio Workbench, RStudio Package Manager, and RStudio Connect.  RStudio Team offers convenience, simplicity, and savings to organisations using R, Python and RStudio at scale.

- Free to academia for teaching

- Allows best practice usage of R markdwon, Git and dockerisation.
]
.pull-right[
![](data:image/png;base64,#img/Team.png)
]
---
class: middle

# What is wrong with computer labs?

.large[
Compared to the computer labs approach, our approach has three distinct benefits:

1. Passive lecturing then active labs are replaced by dynamic lectures and labs and 24/7 access to computing for active independent learning;
2. Help students who have cost constraints or limitation to accessing computing hardware;
3. Ease of sharing code, data and environments.
]

---
class: middle

.pull-left[
### you used to have this
<img src="data:image/png;base64,#img/jonathan-borba-PZBjJ12Xv2s-unsplash.jpg" width="70%" />
]
--
.pull-right[
### and now you have this
<img src="data:image/png;base64,#img/sincerely-media-o5Key-1HzaY-unsplash.jpg" width="80%" />
]

.footnote[
.tiny[Photos by Jonathan Borba and Sincerely Media on Unsplash.]
]
---
class: middle

.pull-left[
  .huge-text[Why]
]
.pull-right[
  .larger[
  RStudio  
  in the cloud?
  ]
]

---
class: middle

.pull-left[
### lots of friction points

- Install R
- Install RStudio
- Install the following packages:
  - rmarkdown
  - tidyverse 
  - ...
- Load these packages
- Install git
]

.pull-right[
### much less friction

- Go to rstudio.cloud
- Log in

```r
>hello R!
```
]

---
class: middle

.pull-left[
  .huge-text[How]
]
.pull-right[
  .larger[
  RStudio  
  in the cloud?
  ]
]

---
class: middle

.pull-left[
- .acid[RStudio Workbench (Advanced teaching)]
You have...
- sysadmin experience / IT support
- hardware / local VM / cloud computing credit
- RStudio experience
]
.pull-right[
- .acid[RStudio Cloud]

You have...
- RStudio experience
]

---
class: middle

.pull-left[
  .huge-text[Hello]
]
.pull-right[
  .larger[
  Q-RaP
  RStudio  
  Cloud
  ]
]

---
class: middle

## What is RStudio Cloud?

<br>

.pull-left-narrow[
<img src="data:image/png;base64,#img/cloud.png" width="264" />
]
.pull-right-wide[
.large[[**RStudio Cloud**](https://rstudio.cloud/) created to make it easy for professionals, hobbyists, trainers, teachers, and students to do, share, teach, and learn data science using R.]
]

---
class: middle

.center[
<img src="data:image/png;base64,#img/rstudio-ide.png" width="80%" />
]

---
class: middle

.center[
<img src="data:image/png;base64,#img/rstudio-cloud.png" width="80%" />
]

---
class: middle

## Why RStudio Cloud?

- Does not require IT support

--
- Git works out of the box
- Knit to PDF and Word works out of the box

--
- Features designed for instructors

---
class: middle

## Contexts

- Shorter workshops: Likely no opportunity to communicate pre-workshop instructions, varied computing background and learning goals

- Semester long courses
  - Intro data science / statistics: little to no background in stats, data science, programming
  - Upper level data science / statistics: Varied computing background and different computer setups

---
class: middle

## RStudio Cloud: First look

---
class: middle

## Workspaces

- When you create an account on RStudio Cloud you get a workspace of your own

- You can add a new workspace and control its permissions

- Projects in either workspace can be public or private

---
class: middle

## A framework for workspaces

---
class: middle

## Projects

.pull-left[
A new project in RStudio Cloud
<img src="data:image/png;base64,#img/new-project-cloud.png" width="90%" style="display: block; margin: auto;" />
]
.pull-right[
is a new project in RStudio IDE
<img src="data:image/png;base64,#img/new-project-local.png" width="90%" style="display: block; margin: auto;" />
]

.alert[
**Top Tip:** If you use RStudio, use projects! Trust me, you won’t regret it. Find out more on [R for Data Science](https://r4ds.had.co.nz/workflow-projects.html).
]

---
class: middle

# Computational Notebooks
- Computational notebooks are documents that combine code, discussion and output in a dynamic reproducible format. 
- An essential advantage of computational notebooks is that they embody the PPDAC credible analysis workflow (Problem, Plan, Data, Analysis, Communication). 
- PPDAC is the professional standard for data analysis and plausible inference[@Spiegelhalter2019].
- Unlike the copy and paste approach, all five parts of the PPDAC approach can be included in one document, providing an enhanced level of transparency, portability and reproducibility.

---
class:middle

## Git and GitHub

.pull-left[
<img src="data:image/png;base64,#img/git-logo.png" width="25%" />
- Git is a version control system -- like “Track Changes” features from Microsoft Word, on steroids
- It's not the only version control system, but it's a very popular one
]
.pull-right[
<img src="data:image/png;base64,#img/github-logo.png" width="25%" />
- GitHub is the home for your Git-based projects on the internet -- like DropBox but much, much better

- We will use GitHub as a platform for web hosting and collaboration (and as our course management system!)
]

---
class: middle

## Versioning

---
class: middle

## Versioning

### with human readable messages

---
class: middle

## Why do we need version control?

---
class: middle

## How will we use Git and GitHub?

---
class: middle

## How will we use Git and GitHub?

---
class: middle

## How will we use Git and GitHub?

---
class: middle

## How will we use Git and GitHub?

---
class: middle

# Git and GitHub tips

- There are millions of git commands -- ok, that's an exaggeration, but there are a lot of them -- and very few people know them all. 99% of the time you will use git to add, commit, push, and pull.

--
- We will be doing Git things and interfacing with GitHub through RStudio, but if you google for help you might come across methods for doing these things in the command line -- skip that and move on to the next resource unless you feel comfortable trying it out.

--
- There is a great resource for working with git and R: [happygitwithr.com](http://happygitwithr.com/). Some of the content in there is beyond the scope of this course, but it's a good place to look for help.

---
class: middle

.hand-large[thank you! <br>Questions?]

- All my material can be found at https://github/quinfer/open-science-analytics

- .hand[My Jerry Maguire Moment:]

.blockquote[Quinn, B. Teaching open science analytics in the age of financial technology. QMS Working Paper Series (Under Review at Journal of International Financial Markets, Institutions and Money ) (2022) doi:10.2139/ssrn.4019430.]